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ABSTRACT 

This Education Consolidation and Improvement Act 
(ECIA), Chapter II project combined acquisition of instructional 
equipment with teacher training to improve the geographic skills of 
students in grades six through eight in the Dade County Public 
Schools, Florida. Map and globe materials from three different 
publishers (the George F. Cram Company, the Nystrom Company, and Rand 
McNally) were purchased and applied for this purpose. One teacher 
fro..i each of the district's 47 middle and junior high schools was 
trained in the use of specific materials through the district's 
teacher education center, assisted by publishers' representatives. 
One class in each participating school was taught a four-week unit in 
geographic skills. Evaluation was by the National Council for 
Geographic Educetion Competency-Based Geography Test, Intermediate 
Level. Acceptable data were obtained from 35 schools. Pretest to 
posttest gains were significant at all schools. Analysis of the 
effect of publishers' materials indicated that the materials 
published by the George F. Cram Company were more effective in grades 
six and seven than the other publishers' materials. ( Author /MDE) 



********************************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 

*********************************************************************** 



ERIC 



/ DC V 



DADE COUNTY PUBLIC SCHOOLS 



EVALUATION OF THE 1985-86 
ECIA, CHAPTER II 
TEACHING GEOGRAPHIC SKILLS PROJECT 



US DEPARTMENT OF EDUCATION 

Office of Educational Research an < improvement 

EOUCATiONAL RESOURCES INFORMATION 

CENTER (ERIC) 
V v Thts document has been reproduced as 
-^ received from the person or organization 
originating it 
r Minor changes have been made to improve 
reproductton Quality 



• Points of view or opinions stated m this docu 
ment do not necessarily represent official 
QERi position or policy 



•PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)" 



OFFICE OF EDUCATIONAL ACCOUNTABILITY 




MAY 1986 



9 

ERIC 



THE SCHOOL BOARD OF DADE COUNTY, FLORIDA 



Mr. Robert Renick, Chairman 
Dr. Kathleen B. Maarath, Vice-Chairman 
Mr. G. Holmes Braddock 
Mr. Paul Cejas 
Dr. Michael Krop 
Ms. Janet R. McAliley 
Mr. William H. Turner 



Dr. Leonard Britton 
Superintendent of Schools 



6 



EVALUATION OF THE 1985-86 
ECIA, CHAPTER II 
TEACHING GEOGRAPHIC SKILLS PROJECT 



Principal Evaluator/ Author: Donald R. Morris, Ph.D. 



Dade County Public Schools 
Office of Educational Accountability 
1450 Northeast Second Avenue 
Miami, Florida 33132 



MAY 1986 



9 

ERIC 



4 



TABLE OF CONTENTS 



9 

ERIC 



Description of the Project #># 2 

The Evaluation # # 2 

Purchase and Distribution of Equipment 2 

Training of Teachers 2 



The 4-Week Skills Unit 



Appendix B. 



2 



Analysis of the Test Scores e 

Discussion and Recommendations 

Appendix A 



EVALUATION OF THE 1985-86 
ECIA, CHAPTER II 
TEACHING GEOGRAPHIC SKILLS PROJECT 



Executive Summary 

The project for teaching geographic skills combined the 
acquisition of instructional equipment with teacher training to 
improve the geographic skills of students in grades six through 
eight. Map and globe materials from three different publishers 
were purchased and applied to this purpose. Representatives from 
each of the three publishers participated in inservice training 
for project teachers. 

After the equipment was received and the teachers trained, a 4- 
week skills unit was taught to a class of students in one of the 
grades 6 through 8, in each school, and the results appraised 
through pre- and posttesting. 

The evaluation found the project to have performed all activities 
as specified in the proposal. Additionally, statistically 
significant pretest to posttest gains were made by students in 
virtually all of the project schools. Analysis of the test 
scores resulted in the following recommendation. 

1. Concerning the acquisition of materials for teaching map 
and globe skills at the 6th and 7th grade levels, the 
analysis indicates that materials produced by the George F. 
Cram Company should be given preference over those from the 
Nystrom Company or Rand McNally, where it is feasible to do 
so . 
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Description of the Project 



The 1985-86 project for teaching geographic skills was funded in 
the amount of $100,000 under the Education Consolidation and 
Improvement Act (ECIA) , Chapter II. The project is described as 
combining teacher training with the acquisition of instructional 
equipment to improve the geographic skills of students in grades 
six through eight. y 

The project proposed to train one teacher from each junior 
high/middle school in the teaching of map and globe skills, and 
to purchase map and globe equipment for each of the schools. 

After the equipment was received and the teachers trained a 4- 
v:eek skills unit was taught to a class of students in one 'of the 
grades 6 through 8, in each school, and the results appraised 
through pre- and posttesting with a published test 3elected and 
purchased for the purpose. 



The Evaluation 
Purchas e and Distribution of Equipment 

Purchase orders for the acquisition of map and globe materials 
and for the testing materials, for the middle and junior hiqh ' 
schools were examined. Although it was not mentioned in the 
proposal teaching materials of comparable scone and quality were 
purchased from the three companies which offered material of this 
kind: The George F. Cram Company, the Nystrom Company, and Rand 

Y : Sixteen units were purchased from each publisher. 
Although the packages were not randomly assigned to the schools 
the alphabetical order of distribution that was used did tend to 
distribute each type of materials more or less equally across all 
the administrative areas. 

T raining of Teachers 

The program director provided rosters of teachers who 
received TEC-conducted inservice training in map and globe skills 
in one of three sessions from mid-December, 1985 through mid- 
January 1986 (one session for each of the three material package 
types) .A representative from each of the publishers participated 
m the training. One teacher from each participating school 
received inservice in the use of the materials package that that 
school was to receive. According to the summary evaluation 
reports received by the program director from the TEC, the 
teachers in each group rated the inservice well above average. 

The 4-Week Skills TTnit 

Tjging one class in each participating school was taught a four 
week unit by the newly trained teacher, using the newlyacqSired 



materials. Tests were administered to determine the extent to 
which students receiving instruction in the skills unit showed 
improvement in geographic skills. Pre and posttesting of all 
student participants was conducted by participating teachers at 
each of the participating schools, using a test developed by the 
National Council of Geographic Education, the Intermediate Level 
Geography Test. The nroject director reports that the 
representatives of a. 1 the companies saw the testing instrument, 
and each approved. 

Of 75 questions on the test, only 42, selected by project 
personnel to reflect the subject matter taught, were 
administered. This reduction in the question set is described by 
the project director in a memorandum to the participating 
teachers, included here as Appendix A. 

The testing materials were distributed by school mail on January 
27, 1986, and the results of the pre- and posttesting returned in 
mid-March . 

Preliminary test results by school . There are 47 middle and 
junior high schools in the district, and according to project 
personnel all returned pre- and posttest results for the classes 
which participated in the geography skills classes. The teachers 
who taught and tested the students were responsible fo">- this 
reporting. 

Although all schools returned data in some form, not all the 
information was usable. Only cases with both a pretest and a 
posttest score were recorded. Also, only 38 schools reported 
data in an acceptable form, and only 35 could be used in the 
evaluation analysis. The exceptions are noted below. 

Table 1 gives the pre- and posttest score summaries for the 38 
schools for which data were processed, since there was no control 
group for the project taken as a whole, only a t statistic and 
associated p level is reported for each school. The results for 
most were highly significant statistically, and only four schools 
failed to achieve significance at the .05 level. Given that 
the^e skills are unlikely to be learned outside the classroom, 
and considering that the period of instruction was only 4 
consecutive weeks, it is reasonable to regard the gains shown in 
table 1 as an accurate reflection of classroom activities. 

Schools omitted, and distribution of surviving schools . As not«d 

above, test data from only 35 (or 75 percent) of the 47 
participating schools were usable in the analysis. For three 
schools, data were reported for the school-by-school analvsis in 
table 1, but not used in the covariance analvsis. Two schools 
6251 and 6331, reported a mixed class of 7th and 8th grades, with 
no way of distinguishing the scores, since it. was desirable to 
separate 7th and 8th graders, these schools were left out. 
Another school, 6881, tested gifted 7th grade students, resulting 
in a ceiling effect in the data. 
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Table 1 



Test Results By School for 
the 4-Week Skill Unit Classes 



No. Location N 



Pretest 
Avg StD 



Posttest 
Avg StD 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 



6011 

6021 

6030 

6061 

6071 

6C81 

6091 

6141 

6171 

6211 

6221 

6241 

6251 

6301 

6331 

6351 

6371 

6391 

6411 

6431 

6441 

6481 

6541 

6571 

6631 

6681 

6721 

6/41 

6761 

6781 

6801 

6821 

6841 

6861 

6881 

6911 

6961 

6981 



21 
23 
22 
31 
28 
23 
23 
25 
30 
26 
33 
20 
16 
24 
23 
19 
24 
26 
23 
13 
28 
18 
27 
33 
18 
24 
27 
24 
25 
22 
35 
16 
32 
30 
9 
22 
25 
22 



17.14 
27.52 
15.27 
26.90 
22.61 
29.39 
18.30 
15.48 
25.80 
31.69 
34.55 
14.60 
27.75 
29.71 
22.04 
16.95 
24.83 
20.46 
9.57 
17.77 
27.68 
21.72 
23.19 
29.15 
24.44 
22.88 
19.15 
20.04 
20.96 
23.18 
26.34 
31. 06 
29.72 
23.83 
33.56 
23.55 
24.12 
19.95 



5.30 

4. 92 

7.37 

7.85 

7.72 

5.79 

5.83 

4.24 

5.50 

5.28 

4.05 

6.08 

9.26 

8.71 

6.42 

6.92 

4.04 

7.38 

5.35 

6.23 

6.23 

5.59 

5.58 

4.74 

6.80 

6.42 

7.09 

9. 94 

6.23 

6.55 

7.43 

6.25 

5.78 

7.38 

3.24 

6.24 

7.76 

7.18 
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22.07 
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3.44 
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7.03 


4.01 
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25.16 


K.35 


3.57 


0.00177 




26.09 


5.85 


2.58 


0.01659 




32.49 


4.99 


7.55 


0.00000 




33.19 


5.27 


4.82 


0. 00041 




30.53 


5.95 


1.22 


0.22803 




31. 00 


5.89 


8.64 


0.00000 




40.56 


0.50 


6.35 


0.00043 




33. 05 


6.50 


24.7 


0.00000 




33.08 


3.16 


6.21 


0.00002 




22.91 


6.23 


2.40 


0.02459 





♦Asterisks indicate schools where mean differences are not 
significant at the .05 level. 

Another nine schools in question were omitted due to unacceptable 
data format or other irregularities, or because the inventory 
forms could not be located. * 



There is good indication that this loss of schools from the 
analysis did not introduce any serious bias into the 
distribution. Table 2 shows the distribution of schools and 
students tested over the selected variables of interest. The 
schools areas evenly divided as possible over the areas of 
administration, reducing the problem of over- or 
underrepresenting the inner city or suburban schools. The 
schools are also evenly divided in the number that use each of 
the three different materials packages. 

Table 2 

Distribution of the 35 Schools 
in the Analysis By Relevant Groupings 



Grouping 



Number 
of Schools 



Number 
of Students 



Area 



North 

North Central 
South Central 
South 



Grades 



8 
9 
9 

9 



6 4 

7 9 

8 20 

9 2 

Grades Grouped 

Lower (6&7) 13 

Upper (8&9) 22 

Materials source 

Cram Co. (C) 12 

Nystrom Co. (Nl 11 

Rand McNally (R) 12 

Materials by Grade Level 

Lower (grades 6 & 7) 

C/6&7 4 

N/6&7 5 

R/6&7 4 

Upper (grades 8 & 9) 

C/8&9 8 

N/8&9 9 

R/8&9 8 



192 
211 
233 
226 



110 
219 
482 
51 



329 
533 



329 
269 
264 



114 
123 
92 

215 
146 
172 



Overall Totals 



35 



862 
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The schools were not equally divided on the grades tested, 
however, a fact also true of the total set of schools. More 
eighth grade classes were taught and tested than the other grades 
combined. There were not enough 6th or 9th grade classes zo 
cover all the types of materials packages. To address these 
problems, the schools testing 6th and 7th grade classes were 
combined to create a lower grade group, and the schools testing 
8th and 9th grades were combined into an upper level group. The 
materials groupings were then found to be equally distributed bv 
school across each grade level grouping, when level was 
controlled. This was considered acceptable for an analysis of 
grade-by-materials effects. 

Analysis of the Test Scores 

Variance accounted for . The summary statistics for the factorial 
analysis of covariance are given in Appendix B. A regression 
approach with effect coding was used, and the variables included, 
including the interaction terms, accounted for about 49 percent 
of the variance. As with most studies of this type the 
covariate (the pretest) is responsible for most of the variance 
accounted for, some 44 percent. The "treatment" effects of 
interest (i.e. the different publishers' packages) account for 
around 3 percent, but the effect is highly significant, 
level llY * TherS iS n ° significant interaction with grade 

The adjusted means . Table 3 gives the adjusted means from the 
analysis of covariance. For the lower level (grades 6 and 7) , 

Table 3 

Adjusted Posttest Means 
By Grade Level and Materials Publisher 



Grade 


c 


N 


R 


Lower (6&7) 


31.21 


26.30 


26.56 


Higher (8&9) 


31.75 


30.08 


29.17 



£ olISlJ f«Slr 9 S UP SCh °° 1S USing the " C " mater i*ls Package 
iLfi ; Y i ar f er than th e means for the other two groups at that 
level, m fact, using this package, the lower level students 

fSSSi 11 "S L" J hose „ in the u PP<*r level. The difference 
?! !?!?•*£? C " treatm ? n r and the other two at the lower level 
i™Ho a ?o^ Ca i ly si ^- lficant be yond the .01 level. At the upper 
grade level, however, the means do not differ across the 
different materials types at the .05 level, indicating that it 
does not matter among 8th and 9th graders which set of materials 
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Discussion and Recommendations 

The geographic skills project was found to have performed all the 
activities specified in the project proposal: equipment was 
purchased and distributed to the specified schools; consultants 
were engaged and teachers trained in the use of the equipment; 
each teacher taught, tested, and reported test results for a 4- 
week unit on geographic skills. 

Since the project is completed, and no further activities 
planned, no recommendations regarding the project are warranted 
However, the analysis of the test results suggests the following 
recommendation concerning the purchase and use of map-and-qlobe 
materials in 6th and 7th grade classrooms. 

1. Concerning the acquisition of materials for teaching map 
and globe skills at the 6th and 7th grade levels, the 
analysis indicates that materials produced by the George F 
Cram Company should be given preference over those from the 
Nystrom Company or Rand McNally, whore it is feasible to do 
so. 
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Appendix A 



MEMORANDUM 



January 27, 1986 



TO: 



FROM: 




Social Studies 

SUBJECT: EVALUATION OF THE MAP AND GLOBE SKILLS PROGRAM 



Enclosed you will find materials to be used to evaluate the Map and Globe 
Skills Program implementation in your school* The materials include a packet 
for the National Council for Geographic Education Competency-Based Geography 
Test, Intermediate Level. The packet includes an administrator's manual, 
35 student test booklets, a matrix for grading, a black-line mas* r answer 
sheet, and a student inventory sheet. 

As was stated in the workshop, you are to administer the pretest to one class 
of students prior to beginning the map and globe skills unit. Please grade 
each student's test and record the raw score of correct responses after the 
name of each student on the student inventory sheet. At the conclusion of 
the unit administer the posttest results in the same manner. As in the case 
of the maps and globes, you . may retain the test materials for future use. 
The only item tu be returned to me (mail code 9999 - Room 920) is the student 
inventory sheet. This should be returned no later than March 14, 1986. 

The items to be answered by students are as follows: 

# 1 through 14, 16, 28 through 31, 34, 35, 36, 38, 40 
through 44, 54, 55, 61, 62, 64, 65, & 68 through 75. 
(A total of 42 items). 

The pretest and posttest are one in the same. The test is not a timed test. 
Use your own judgment. 

Thank you for your cooperation in this project. I hope the training you 
received and the materials sent to you wi 1 1 be beneficial to your school's 
instructional program. If you have any questions, please do not hesitate 
to contact me at 376-1985. 

PSH/mb 

cc: Principal 

Project Managers 
Tom Dunthorn 

Enclosures 
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Appendix B 



SUMMARY OF THE ANALYSIS OF COVARIANCE 
FOR THE GEOGRAPHIC SKILLS PROJECT 

Covariate = pretest 

Grade Level » lower (6th and 7th), upper (8th and 9th). 
Materials = three types of map and globe packages, where C 
represents the Geo. cram Co. product, N stands for the Nystrom 
Co.'s product, and R is for the Rand-McNally package. 



Hierarchic 

VARIANCE PROF. OF SUM OF MEAN Step-down 

SOURCE VARIANCE SQUARES df SQUARES F-ratio 



Pretest 


0.440133 


29698.898 


1 


29698.898 


736.276 


0. 00000 


Grade Level 


0.015794 


1065.737 


1 


1065.737 


26.421 


0. 00000 


Materials 


0.028329 


1911.546 


2 


955.773 


23.695 


0. 00000 


Interaction 


0.006432 


434.028 


5 


86.806 


2.152 


0. 05666 


Error 


0.509312 


34366.836 


852 


40.337 






Total 


1.000000 


67477.045 


861 








MEANS: 
















Lower Grades 
C N 


R 


C 


Higher Grades 

N r 


Original 


32.18 


°3.41 26 


.41 


33.53 


28.72 


29.62 


Adjusted 


31.21 


26.30 26 


.56 


31.75 


30.08 


29.17 
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The School Board of Dade County, Florida adheres to a policy of 
nondiscrimination in educational programs/activities and employment 
and strives affirmatively to provide equal opportunity for all as required 
by: 

Title VI of the Civil Rights Act of 1964 • prohibits discrimination 
on the basis of race, color, religion, or national origin. 

Title VII of the Civil Rights Act of 1964, as amended • prohibits 
discrimination in employment on the basis of race, color, religion, 
sex, or national origin. 

Title IX of the Education Amendments of 1972 • prohibits 
discrimination on the basis of sex. 

Age Discrimination Act of 1967, as amended - prohibits dis- 
crimination on the basis of age between 40 and 70. 

Section 504 of the Rehabilitation Act of 1973 • prohibits dis- 
crimination against the handicapped. 

Florida Educational Equity Act • prohibits discrimination on 
the basis of race, sex, national origin, marital status or handicap 
against a student or employee. 

Veterans are provided re-employment lights in accordance with P.L 
93-508 (Federal) and Section 295.07, Florida Statutes, which also 
stipulates categorical preferences for employment. 




